(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




(12) 



(43) Date of publication: 

02.01.2003 Bulletin 2003/01 

(21 ) Application number: 02004892.2 

(22) Date of filing: 04.03.2002 



(H) EP 1 271 933 A2 

EUROPEAN PATENT APPLICATION 

(51) lntCl7: H04N 5/217 



(84) Designated Contracting States: 


• Kakarala, Ramakrishna 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Sunnyvale, CA 94086 (US) 


MC NL PT SE TR 


• Zhang, Xuemei 


Designated Extension States: 


Mountain View, CA 94043 (US) 


AL LT LV MK RO SI 


• Vook, Dietrich Werner 




Menlo Park, CA 94025 (US) 


(30) Priority: 28.06.2001 US 895627 






(74) Representative: Liesegang, Eva et al 


(71 ) Applicant: Agilent Technologies, Inc. (a Delaware 


Forrester & Boehmert, 


corporation) 


Pettenkoferstrasse 20-22 


Palo Alto, CA 94303 (US) 


80336 Munchen (DE) 


(72) Inventors: 




• Baharav, Izhak 




San Jose, CA 95124 (US) 





CM 

< 

CO 
CO 

ov 

CM 



Q. 

LU 



(54) Bad pixel detection and correction in an image sensing device 



(57) A sensor (100) includes an array of photode- 
tectors (102) each generating an output signal of pixel 
data (1 08) indicative of incident light intensity. This pixel 
data (108) is read out from the array one line at a time 
and stored in a line buffer (104). A bad pixel processor 
(110) includes a first buffer (104) that stores pixel data 
(108) obtained from the line buffer (116) for a certain 
pixel in a currently read out line and pixel signal light 
data for pixels adjacent to the certain pixel. An included 
second buffer (122) stores features that are indicative 
of whether the pixels in a previously read out line were 
identified as bad pixels. Using the information in the first 
and second buffers, the processor (110) identifies 
whetherthe certain pixel is a bad pixel. In one operation, 



the processor (110) precludes any finding of the certain 
pixel as being a bad pixel if the features in the second 
buffer (122) indicate that a pixel in the previous line that 
is adjacent to the certain pixel in the current line was 
identified as a bad pixel. In another operation, the proc- 
essor (110) applies a variable detection threshold 
against the certain pixel, with the value of that threshold 
being set higher if the features in the second buffer (1 22) 
indicate that a pixel in the previous line that is adjacent 
to the certain pixel in the current line was identified as 
a bad pixel. When a bad pixel is detected, a correction 
algorithm is executed to replace the pixel data (1 08) for 
the bad pixel with data that more accurately represents, 
estimates or approximates the intensity of the light that 
is incident on the photodetector. 
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Description 

BACKGROUND OF THE INVENTION 

Technical Field of the invention 

[0001] The present invention relates to an image 
sensing device comprising an arrayed plurality of pho- 
todetectors and, in particular, to the detection of bad pix- 
els in such a device and the correction of pixel data out- 
put from those bad pixels. 

Description of Related Art 

[0002] It is well known in the art to assemble a plurality 
of photodetectors (also referred to in the art as "pho- 
tosites") in an array format to create an image sensing 
device. Each individual photodetector operates to out- 
put a signal whose magnitude is proportional to the in- 
tensity of light incident. on the site of the photodetector 
These output signals can then be subsequently proc- 
essed and manipulated to generate an image com- 
prised of a plurality of individual picture elements (also 
referred to in the art as "pixels"), wherein each pixel in 
the image corresponds with one of the photodetectors. 
[0003] The individual photodetectors used in such a 
sensing device are typically photodiodes that are 
formed on a semiconductor substrate or chip. The array 
of these photodetectors may include thousands (if not 
hundreds of thousands or millions) of individual photo- 
detectors. Even with a semiconductor manufacturing 
process having a 99% yield, it is recognized that the 
sensing device array will inevitably include a number of 
bad photodetectors (also referred to herein as "bad pix- 
els"). Requiring a semiconductor production line to pro- 
duce sensors without any bad pixels is a very stringent 
and perhaps an economically unfeasible and unrealiz- 
able demand. It is accordingly accepted for sensors to 
include some bad pixels as long as a suitable mecha- 
nism is available to detect the bad pixels and satisfac- 
torily correct the photodetector output signals. These 
detection/correction mechanisms generally comprise 
hardware or software processes that detect bad pixels 
based on their output signals and alter/replace their out- 
put signals to more accurately reflect the intensity of the 
light incident on the photodetector. 
[0004] A bad pixel within a sensor may arise in a 
number of ways. First, the signal output from the photo- 
detector may always give a high reading (a "hot pixel"). 
This defect produces a brighter than expected spot in 
the generated image. Second, the signal output from the 
photodetector may always give a low reading (a "dead 
pixel"). This defect produces a darker that expected spot 
in the generated image. Third, a signal proportional to 
the incident light may be generated, but (due, for exam- 
ple, to incorrect photodiode gain, dark current and/or off- 
set) does not accurately represent of the incident light 
in the sense that it differs from signals generated by oth- 



er similarly situated photodetectors (a "noisy pixel"). 
This defect produces an erroneous spot (color, intensity, 
contrast, and the like) in the generated image. 
[0005] FIG. 1 shows a simplified schematic diagram 

5 of a sensor read-out operation in accordance with the 
prior art. A sensor array 10 includes a plurality of pho- 
todetectors 12. Each photodetector 12 outputs a signal 
(referred to herein as "pixel data") whose magnitude ide- 
ally has a predetermined monotonic relationship to the 

10 intensity of light incident on the photodetector. Although 
not explicitly shown, the generated signal for each pixel 
has a digital format (obtained through appropriate ana- 
log-to-digital conversion) normally ten to twelve bits in 
size. 

is [0006] A read-out buffer 14 is used to read out and 
capture either a horizontal row or vertical column of in- 
dividual pixel data that is generated from the photode- 
tectors. In this context, a horizontal row or a vertical col- 
umn is referred to as a "line" 16. Following capture of a 

20 line 16 of pixel data in the buffer 14, each individual 
piece of pixel data 18 is processed by a bad pixel proc- 
essor 20. The processor 20 operates to serially examine 
each piece of pixel data 1 8 in a line 1 6, detect instances 
where that piece of data has been output by a bad pixel , 

25 and in such cases effectuate a correction on the pixel 
data so that it more accurately represents the intensity 
of the light that is incident on the photodetector. Pixel 
data is then serially output 22 by the processor 20 for 
each pixel in either its original form 24 (i.e., as read out 

30 by the buffer 1 4) or a modified form 24' (i.e. , as corrected 
when a bad pixel is detected). 

[0007] FIG. 2 shows a block diagram illustrating one 
known operation for bad pixel processing performed by 
processor 20 of FIG. 1 . The bad pixel processor 20 se- 

35 rially processes the pixel data 1 8 captured by the buffer 
14 for one line 16 (see, FIG. 1) one pixel at a time (ge- 
nerically referred to as pixel "X") in order to determine if 
each piece of the pixel data under examination is gen- 
erated by a bad pixel. To assist in the making of this 

40 determination, the mechanism includes a data buffer 26 
that stores the pixel data 1 8 (as captured in buffer 14) 
for not only the pixel X under examination, but also for 
the pixels Y and Z that neighbor (e.g., are immediately 
adjacent to) the pixel X in the same read-out line 16. 

45 [0008] A detection algorithm 28 processes the pixel 
data 1 8 for pixels X, Y and Z and determines if the pixel 
data for pixel X differs from the pixel data for pixels Y 
and Z (either individually, by median or on average) by 
a deviation that exceeds a certain threshold. If not, the 

so pixel data 18 for pixel X is assumed to represent valid 
pixel data generated from a good pixel, and is serially 
output 22 in its original form 24. If there is an excessive 
deviation (beyond the threshold), the pixel data 18 for 
pixel X is assumed to be generated from a bad pixel, 

55 and a correction algorithm 30 is executed to modify the 
pixel data to produce modified pixel data 24' that at- 
tempts to more accurately represent the intensity of the 
light that is incident on the photodetector. As an exam- 
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pie, the correction algorithm may replace the pixel data 
1 8 for pixel X with pixel data 24* comprising the median 
or average value of the pixel data 18 for the adjacent 
pixels Y and Z on the same line 1 6 . As another example , 
the correction algorithm may replace the pixel data 18 
for pixel X with pixel data 24' comprising the pixel data 
18 for either one of the adjacent pixels Y or Z on the 
same line 16. Numerous other operations for correcting 
pixel data from bad pixel are known in the art. Following 
correction, the modified data 24" for pixel X is passed to 
serial output 22. 

[0009] FIG. 3 shows a block diagram illustrating an- 
other known operation for bad pixel processing per- 
formed by the processor 20 of FIG. 1. The bad pixel 
processor 20 serially processes the pixel data 18 cap- 
tured by the buffer 14 for one line 16 (see, FIG. 1) one 
pixel at a time (generically referred to as pixel M X") in 
order to determine if any of the pixel data under exam- 
ination is generated by a bad pixel. To assist in the mak- 
ing of this determination, the processor 20 includes a 
data buffer 26 that stores the pixel data 1 8 (as currently 
captured in buffer 14) for not only the pixel X under ex- 
amination, but also for the pixels Y and Z that neighbor 
(e.g., are immediately adjacent to) the pixel X in the cur- 
rently read-out line 1 6(n). To further assist in the making 
of this determination, the processor 20 includes a data 
buffer 32 storing the pixel data 18 that was previously 
captured in buffer 14 for an adjacent, previously read- 
out line 16(n-1). More specifically, the pixel data 18 of 
interest comprises that pixel data for pixels A, B and C 
that most closely neighbor pixel X in the previously read- 
out line 16(n-1). 

[0010] A detection algorithm 28 processes the pixel 
data 18 for pixels A, B, C, X, Y and Z and determines if 
the pixel data for pixel X differs from the pixel data for 
pixels A, B, C, Y and Z (either individually, in pairs or 
groups, by median or on average) by a deviation that 
exceeds a certain threshold. If not, the pixel data 1 8 for 
pixel X is assumed to represent valid pixel data gener- 
ated from a good pixel, and is serially output 22 in its 
original form 24. If there is an excessive deviation (be- 
yond the threshold), the pixel data 18 for pixel X is as- 
sumed to be generated by a bad pixel, and a correction 
algorithm 30 is executed to modify the pixel data to gen- 
erate modified pixel data 24' that more accurately rep- 
resents the Intensity of the light that is incident on the 
photodetector. Again, as discussed above, any of the 
known operations for correcting bad pixel signal light da- 
ta may be used, and beneficially pixel data from addi- 
tional pixels (e.g., pixels A s B and C) may be evaluated 
during this correction. Following correction, the modified 
pixel data 24' for pixel X is passed to serial output 22. 
[0011] The bad pixel processing operation of FIG. 3 
considers more pixel data 18 than the operation of FIG. 
2 for purposes of both detecting bad pixels (see, oper- 
ation 28) and correcting/modifying the pixel data for the 
detected bad pixels (see, operation 30). However, the 
operation illustrated in FIG. 3 has a significant memory 



overhead requirement. For example, consider an array 
10 that generates for each photodetector 12 digitized 
pixel data 1 8 that is ten to twelve bits in magnitude, and 
wherein each line 16 includes one-thousand photode- 

5 tectors (such as would be the case, for example, with a 
one mega-pixel sensor array). The bad pixel processor 
20 would accordingly require, for the implementation 
shown in FIG. 3, a buffer 32 memory capable of storing 
10-12 kbits of data in addition to the memory required 

10 for the buffer 26. 

[0012] It is recognized that the array 1 0 along with the 
line read-out buffer 14 and the bad pixel processor 20 
can be implemented on a single integrated circuit chip 
(i.e., the same semiconductor substrate). This is possi- 

?5 ble using, for example, CMOS fabrication techniques 
that allow for such an integration of components and 
functionalities. At the same time, however, even given 
the miniaturization capable through integrated circuit 
fabrication, the array 10 itself along with the associated 

20 circuitry (for example, the A/D conversion circuit, the line 
read-out buffer 14, the detector 28 and the corrector 30) 
take up a significant amount of semiconductor area, and 
there would be an advantage for many applications of 
the sensor if the memory requirements of at least the 

25 previous line 1 6(n-1 ) buffer 32 could be minimized. 

SUMMARY OF THE INVENTION 

[0013] The invention provides a sensor that compris- 
es a plurality of photodetectors arranged in a sensor ar- 
ray. Each photodetector generates an output signal of 
pixel data that is indicative of incident light intensity. This 
pixel data is read out from the array one line at a time 
and stored in a line buffer. The invention further includes 
a bad pixel processor that includes a first buffer storing 
pixel data obtained from the line buffer for a certain pixel 
in a currently read out line and pixel data for pixels ad- 
jacent to the certain pixel. A second buffer included in 
the processor stores characteristic features for each of 
the pixels in a line read out from the array previous to 
the currently read out line. The pixel data stored in the 
first buffer and the characteristic features stored in the 
second buffer are then processed to identify whether the 
certain pixel in the currently read out line is a bad pixel. 
[0014] In one embodiment, processing for bad pixel 
detection includes an operation that precludes any find- 
ing of the certain pixel as being a bad pixel if the char- 
acteristic features in the second buffer indicate that a 
pixel in the previous line that is adjacent to the certain 
pixel in the current line was identified as a bad pixel. 
[0015] In another embodiment, processing for bad 
pixel detection includes an operation that applies a var- 
iable detection threshold against the certain pixel, with 
the value of the threshold being. set higher if the char- 
acteristic features stored in; the second buffer indicate 
that a pixel in the previous line that is adjacent to the 
certain pixel in the current line was identified as a bad 
pixel. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] A more complete understanding of the method 
and apparatus of the present invention may be acquired 
by reference to the following Detailed Description when 
taken in conjunction with the accompanying Drawings 
wherein: 

FIG. 1 , previously described, is a simplified sche- 
matic diagram of a sensor read-out operation in ac- 
cordance with the prior art; 

FIG. 2, previously described, is a block diagram il- 
lustrating one known operation for bad pixel 
processing; 

FIG. 3, previously described, is a block diagram il- 
lustrating one known operation for bad pixel 
processing; 

FIG. 4 is a simplified schematic diagram of a sensor 
read -out operation in accordance with an embodi- 
ment of the present invention; 
FIG. 5 is a block diagram illustrating an operation 
for bad pixel processing in accordance with an em- 
bodiment of the present invention; 
FIG. 6 is a flow diagram illustrating one embodiment 
of a process for bad pixel detection using the 
processing operation of FIG. 5; 
FIG. 7 is a receiver operating characteristics (ROC) 
graph illustrating an improvement in bad pixel de- 
tection operation performance using the process of 
FIG. 6; 

FIG. 8 is a flow diagram illustrating another embod- 
iment of a process for bad pixel detection using the 
processing operation of FIG. 5; 
FIG. 9 is a block diagram illustrating another oper- 
ation for bad pixel processing in accordance with an 
embodiment of the present invention; 
FIG. 10 is a flow diagram illustrating another em- 
bodiment of a process forbad pixel detection using 
the processing operation of FIG. 9; and 
FIG. 11 is an ROC graph illustrating an improve- 
ment in bad pixel detection operation performance 
using the process of FIG. 10. 

DETAILED DESCRIPTION OF THE EXEMPLARY 
EMBODIMENTS OF THE INVENTION 

[0017] FIG. 4 shows a simplified schematic diagram 
of a sensor read-out operation in accordance with an 
embodiment of the present invention. A sensor array 
100 includes a plurality of photodetectors 102. Each 
photodetector 102 outputs a signal (referred to herein 
as "pixel data") whose magnitude ideally has a prede- 
termined monotonic relationship to the intensity of light 
incident on the photodetector. Although not explicitly 
shown; the generated signal for each pixel has a digital 
format (obtained through appropriate analog-to-digital 
conversion) normally ten to twelve bits in size: 
[0018] A read-out buffer 1 04 is used to read out and 



capture either a horizontal row or vertical column of in- 
dividual pixel data that is generated from the photode- 
tectors. In this context, a horizontal row or a vertical col- 
umn is referred to as a "line" 106. Following capture of 
5 a line 1 06 of pixel data in the buffer 1 04, each individual 
piece of pixel data 108 is serially processed in a bad 
pixel processor 1 1 0. The processor 1 1 0 operates to ex- 
amine each piece of pixel data 108, detect instances 
where that piece of pixel data has been output by a bad 

10 pixel, and in such cases effectuate a correction on the 
pixel data so that it more accurately represents the in- 
tensity of the light that is incident on the photodetector. 
Pixel data is then serially output 112 by the processor 
110 for each pixel in either its original form 114 (i.e., as 

is read out by the buffer 104) or a modified form 114* (i.e., 
as corrected when a bad pixel is detected). 
[0019] FIG. 5 shows a block diagram illustrating an 
operation for bad pixel processing performed by proc- 
essor 110 in accordance with an embodiment of the 

20 present invention. The bad pixel processor 11 0 process- 
es the pixel data 1 08 captured by the buffer 1 04 for one 
line 106 (see, FIG. 4) one pixel at a time (generically 
referred to as pixel "X") in order to determine if each 
piece of pixel data under examination is generated by a 

25 bad pixel. To assist in the making of this determination, 
the processor 110 includes a data buffer 116 that stores 
the pixel data 108 (as currently captured in buffer 104) 
not only for pixel X under examination, but also for the 
pixels Y and Z that neighbor (e.g., are immediately ad- 

30 jacent to, or nearby on the same line 106 as) the pixel 
X in the currently read-out line 106(n). To further assist 
in the making of this determination, the processor 110 
includes afeature buffer 1 22 storing a characteristic fea- 
ture (F) 124 (to be described in more detail below) of 

35 each of the pixels in an adjacent previously read-out line 
106(n-1). 

[0020] Generally speaking, the characteristic feature 
124 for a pixel differs significantly from the pixel data for 
a pixel in that the characteristic feature is not indicative 

40 of the magnitude of the incident light, but is rather indic- 
ative of some non-magnitude characteristic relating to 
the pixel. As an example, the characteristic feature 124 
may comprise a bad pixel identification, an edge direc- 
tion identification, line transition identification, and the 

45 like. Importantly, the characteristic feature for a pixel re- 
quires less memory per pixel than pixel data (see, buffer 
32, FIG. 3), thus allowing the feature buffer 122 to have 
as small a size as possible. 

[0021] A detection algorithm 128 processes both the 
so pixel data 1 08 for pixels X, Y and Z in the currently read- 
out line as well as the characteristic features (F) 124 for 
the pixels in the previously read-out line 1 06(n-1 ) to de- 
termine whether pixel X is a bad pixel. It will be under- 
stood that the process performed by algorithm 128 may 
55 ^consider pixel data for other neighboring .pixels ^ if de- 
sired. If the pixel is not bad; the pixel data 1 08 for pixel 
X is assumed to represent valid pixel data generated 
from a good pixel, and is output 112 in its original form 
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114. If pixel X is determined to be a bad pixel, a correc- 
tion algorithm 130 is executed to modify the pixel data 
108 into modified pixel data 114' that more accurately 
represents the intensity of the light that is incident on 
the photodetector. Any selected one of a number of well 
known operations for correcting pixel data from bad pix- 
els may be used. No matter what correction operation 
is used, however, it is preferred that as much pixel data 
as possible, including the pixel data for pixels Y and Z 
(and perhaps other neighbors) in the current line 1 06(n) 
be considered in effectuating the correction. As a further 
enhancement to the invention, the correction operation 
may also consider the characteristic features (F) 124 for 
the pixels in the previous line 106(n-1), in effectuating 
the correction. Following correction, the modified data 
114* for pixel X is passed to serial output 112. 
[0022] FIG. 6 shows a flow diagram illustrating one 
embodiment of a process for bad pixel detection per- 
formed by the processor 110 of FIG. 5. In this embodi- 
ment forthe pixels in the previous line 1 06(n-1 ), the bad/ 
good pixel decisions previously made by the detection 
algorithm 1 28 are used as the characteristic features (F) 
1 24 that are stored in the feature buffer 1 22. These char- 
acteristic features require only a binary (1/0) storage, i. 
e., only one bit per pixel. This serves to significantly re- 
duce the size of the memory required for the feature 
buffer 122 in comparison to that required by the buffer 
32 (FIG. 3) of the prior art. In step 200, the detection 
algorithm 128 uses the pixel data stored in the buffer 
116 and calculates an average or median value (V) for 
the pixel data 1 08 of the pixels Y and Z that are adjacent 
the pixel X under examination (in the same line 106(n)) 
that is used as a reference value. It will be understood 
that the step 200 calculation may use pixel data for other 
neighbors in line 106(n). 

[0023] The detection algorithm 128 then executes 
step 202 and processes the reference value (V) and the 
pixel data 108 for pixel X as stored in buffer 116. More 
specifically, this step 202 processing subtracts the value 
V from the data 1 08 value of pixel X to obtain a difference 
value (D). The detection algorithm 128 then uses the 
characteristic features (F) 1 24 stored in the feature buff- 
er 122 and determines in step 204 whether a pixel (P) 
having the same relative position in the previous line 1 06 
(n-1) as the pixel X under examination in the current line 
106(n) was previously detected as being a bad pixel. 
This pixel (P) is referred to herein as being a "perpen- 
dicularly adjacent 1 ' pixel. If NO, then the difference value 
(D) calculated in step 202 is compared against a first 
threshold (TH1) in step 208. More specifically, this step 
208 comparison determines whether the magnitude of 
the difference value (D) exceeds the first threshold 
(TH1). If, on the other hand, the determination in step 
,204 is YES, then the difference value (D) calculated in 
step; 202 is compared against a, second, . different, 
threshold (TH2) in step 210 More specifically, this step 
210 comparison determines whether the magnitude of 
the difference value (D) exceeds the second threshold 



(TH2). 

[0024] If the executed comparison operation of either 
steps 208 or 21 0 is satisfied (i.e., the appropriate thresh- 
old is exceeded), the detection algorithm 128 identifies 
5 the pixel X under examination as a "bad pixel" in step 
212. This identification of the pixel X as a bad pixel is 
recorded in the feature buffer 122 in step 21 4. Operation 
with respect to pixel X then proceeds to the correction 
algorithm 130 to modify the pixel data 108 in accordance 
10 with a desired correction operation to produce modified 
pixel data 114* that more accurately represents the in- 
tensity of the light that is incident on the photodetector. 
If, on the other hand, the executed comparison opera- 
tion of steps 208 or 210 is not satisfied, this indicates 
15 that the pixel is a "good pixel" data 108 for pixel X is 
assumed to represent valid pixel data generated from a 
good pixel for output 112 in its original form 114. The 
process then returns (step 214) to process a next pixel, 
[0025] Although a specific implementation is shown 
20 for step 200 and 202 to obtain the difference value (D) 
for purposes of comparison to the thresholds TH1 or 
TH2, it will be understood that any suitable procedure 
may be used to obtain information that is indicative of a 
difference between the measured pixel X value (given 
25 by the pixel data) and a reference value. 

[0026] The second threshold (TH2) is preferably set 
higher than the first threshold (TH1) (i.e., TH2>TH1). 
This makes it more difficult for the comparison operation 
of step 210 to be satisfied, and thus identify the pixel X 
30 that is under examination as a "bad pixel" when pixel X 
in line 106(n) is perpendicularly adjacent to previously 
detected bad pixel in line 106(n-1). One reason for this 
is that it is statistically unlikely that two adjacent bad pix- 
els in consecutive lines 106 exist. Another reason for 
35 this is that while the prior art single threshold process of 
FIG. 2 accurately identifies bad pixels in most cases, it 
has an unwanted side effect of erroneously identifying 
good pixels as bad pixels. A domino effect thuSr occurs 
where one erroneous bad pixel detection propagates 
40 among a few adjacent pixels in subsequent lines. The 
dual threshold approach of FIG. 6 acts to reduce this 
unwanted side effect by increasing the threshold level 
that must be satisfied for bad pixel identification when 
the pixel under examination is perpendicularly adjacent 
45 a pixel previously identified as being a bad pixel. 

[0027] The effectiveness of the process for bad pixel 
identification illustrated in FIG. 6 in reducing the unwant- 
ed side effect is graphically illustrated in FIG, 7, which 
shows a receiver operating characteristics (ROC) 
so graph. The ROC graph plots the false alarm rate, which 
indicates the number good pixels being unnecessarily 
corrected (i.e., the unwanted side effect), against the hit 
rate, which indicates the number of bad pixels being ac- 
curately corrected. Curve 220 is a representative ROC 
curve for the single threshold process shown in FIG. 3, 
while curve* 222 is a representative ROC curve for the 
dual threshold process shown in FIGS. 5 and 6. Any 
shifting of the ROC curve towards the upper left hand 
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corner of the graph (i.e. , toward a hit rate of 1 and a false 
alarm rate of 0) represents an improvement in perform- 
ance. As shown in FIG. 7, the curve 222 is shifted in that 
direction relative to the curve 220. It is accordingly con- 
cluded that there is a significant benefit in improved per- 
formance by utilizing different thresholds for the step 
208 and 210 comparisons. This is made possible 
through the use of the characteristic features (F) 1 24 as 
described. It is also noted that, because the character- 
istic features (F) 124 require storage of only a single bit 
per pixel, the size of the buffer 122 is significantly re- 
duced and performance is improved. 
[0028] In an embodiment of the process of FIG. 6, the 
second threshold (TH2) is set to be an integer multiple 
(n) of the first threshold (TH1) (i.e., TH2=nTH1). More 
specifically, and in conjunction with the representative 
ROC curves 220 and 222 shown in FIG. 7, the integer 
multiple is two (2). It will, of course, be understood that 
the multiple "n" need not necessarily comprise an inte- 
ger value, and further that any suitable scaling factor 
could be used provided it produces improved perform- 
ance as measured by its corresponding ROC curve. It 
will also be recognized that the multiple "n" may be var- 
iably set in other ways based on thestored characteristic 
feature data. As an example, in situations where the 
characteristic features record characteristics other than 
bad/good pixel, especially in situations where data has 
more than two possible values, a corresponding plurality 
of thresholds may be applied to give the detection de- 
termination a more robust response and perhaps better 
accuracy. For example, the characteristic feature may 
indicate whether the pixel has an associated edge di- 
rection (right edge, left edge, no edge smooth, no edge 
texture) in the overall image. In this scenario, it is pos- 
sible for a different threshold to be associated with each 
edge direction. As another example, the characteristic 
feature may indicate whether the pixel has an associat- 
ed line transition (peak, valley, ramp, flat) in the overall 
image. Similarly, in this scenario, as an example, it is 
possible for a different threshold to be associated with 
each line transition. 

[0029] FIG. 8 shows a flow diagram illustrating anoth- 
er embodiment of a process for bad pixel detection per- 
formed by the processor 110 of FIG. 5. In this embodi- 
ment, the bad/good pixel decisions previously made by 
the detection algorithm 128 for the pixels in the previous 
line 106(n-1) are used as the characteristic features (F) 
124 for the pixels in the previous line 106(n-1) that are 
stored in the feature buffer 122. These characteristic 
features (F) 124 require only a binary (1/0) storage fea- 
ture, i.e., one bit per pixel. This serves to significantly 
reduce the size of the memory required for the feature 
buffer 122 in comparison to that required by the buffer 
32 (FIG 3) of the prior art. In step 250, the detection 
algorithm 128 uses the characteristic features (F) 124 
stored in the feature buffer 1 22 and determines whether 
a perpendicularly adjacent pixel (P) to the pixel X under 
examination was previously detected as being a bad 



pixel. If the determination in step 250 is YES, the proc- 
ess precludes a finding that pixel X could comprise a 
"bad pixel" and the pixel data 1 08 for pixel X is assumed 
to represent valid pixel data for output 112 in its original 

5 form 114. The process then returns (step 252) to proc- 
ess a next pixel. Put another way, if the process deter- 
mines that the pixel (P) corresponding to pixel X a pre- 
vious line 106(n-1) is a bad pixel (as indicated by the 
stored characteristic feature), then pixel X in a current 

10 line 1 06(n) is not permitted to be identified as a bad pix- 
el. 

[0030] If, on the other hand, the executed determina- 
tion operation of step 250 is NO, the detection algorithm 
128 uses the information stored in the buffer 116 and 

15 calculates (in step 254) an average or median value (V) 
for the pixel data 108 of the pixels Y and Z that are ad- 
jacent the pixel X under examination (in the same line 
106(n)) as a reference value. It will be understood that 
the step 254 calculation may use pixel data for other 

20 neighbors in line 1 06(n). The detection algorithm 128 
then executes step 256 and processes the reference 
value (V) and the pixel data 108 for pixel X as stored in 
buffer 116. More specifically, this step 256 processing 
subtracts the value V from the data 1 08 value of pixel X 

25 to obtain a difference value (D). 

[0031] The difference value (D) calculated in step 256 
is then compared against a threshold (TH) in step 258. 
More specifically, this step 258 comparison determines 
whether the magnitude of the difference value (D) ex- 

30 ceeds the threshold (TH). If YES, the detection algo- 
rithm 128 identifies the pixel X under examination as a 
"bad pixel" in step 260. This identification of the pixel X 
as a bad pixel is recorded in the feature buffer in step 
262. Operation with respect to pixel X then proceeds to 

35 the correction algorithm 1 30 to modify the pixel data 1 08 
into modified pixel data 114' that more accurately repre- 
sents the intensity of the light that is incident on the pho- 
todetector. If, on the other hand, the executed compar- 
ison operation of step 258 is not satisfied, this indicates 

to that the pixel is a "good pixel" and the pixel data 1 08 for 
pixel X assumed to represent valid pixel data for output 
1 1 2 in its original form 1 1 4. The process (step 252) then 
returns to process a next pixel. 

[0032] Although a specific implementation is shown 
45 for step 254 and 256 to obtain the difference value (D) 
for purposes of comparison to the threshold TH, ft will 
be understood that any suitable procedure may be used 
to obtain information that is indicative of a difference be- 
tween the measured pixel X value (given by the pixel 
50 data) and a reference value. 

[0033] Again, it will be understood that characteristic 
features other than bad/good pixel detection can be 
used to drive the preclusion determination of steps 250 
and 252. As an example, when the characteristic fea- 
55 tures record characteristics other than bad/good pixel, 
especially in situations where data has more than two 
possible values; only certain orie(s) of the specific fea- 
tures may drive a preclusion determination where some 
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relationship between that feature and faulty bad pixel 
detection has been noted. For example, the character- 
istic feature may indicate whether the pixel has an as- 
sociated edge direction (right edge, left edge, no edge 
smooth, no edge texture) in the overall image. In this 5 
scenario, as an example, it is possible for only the right/ 
left edge direction to preclude bad pixel identification. 
As another example, the characteristic feature may in- 
dicate whetherthe pixel has an associated line transition 
(peak, valley, ramp, flat) in the overall image. Similarly, 10 
in this scenario, as an example, it is possible for only 
the ramp transition to preclude bad pixel identification. 
[0034] FIG. 9 shows a block diagram illustrating an- 
other operation for bad pixel processing performed by 
the processor 1 1 0 in accordance with an embodiment is 
of the present invention. The bad pixel processor 110 
processes the pixel data 1 08 captured by the buffer 1 04 
for one line 1 06 (see FIG. 4) one pixel at a time (gener- 
ically referred to as pixel "X") in order to determine if 
each piece of pixel data under examination is generated 20 
by a bad pixel. To assist in the making of this determi- 
nation, the processor 1 1 0 includes a two line data buffer 
116' that stores the pixel data 1 08 (as currently captured 
in buffer 1 04) not only for pixel X under examination, but 
also for m neighboring pixels N that are located in the 25 
same line 106(n) as pixel X and in the previous line 106 
(n-1). In an embodiment, m is set equal to thirteen (as 
illustrated in FIG. 1 0), to store pixel data for six pixels in 
line 106(n) and seven pixels in line 106(n-1). It will be 
understood, however, that m can be set equal to any 30 
suitable integer value and any desired pieces of pixel 
data may be stored. To further assist in the making of 
this determination, the processor 1 1 0 includes a feature 
buffer 122 storing a characteristic feature (F) 124 (to be 
described in more detail below) of each of the pixels in 35 
an adjacent previously read-out line 106(n-1). 
[0035] A detection algorithm 128 processes the pixel 
data 1 08 for pixel X and the pixels N as well as the char- 
acteristic features (F) 1 24 for the pixels in the previously 
read-out line 106(n-1) to determine whether pixel X is a 40 
bad pixel. If not, the pixel data 1 08 for pixel X is assumed 
to represent valid pixel data generated from a good pix- 
el ; and is output 112 in its original form 114. If pixel X is 
determined to be a bad pixel, a correction algorithm 1 30 
is executed to modify the pixel data 108 In accordance *s 
with a desired correction operation into modified pixel 
data 114' that more accurately represents the intensity 
of the light that is incident on the photodetector. Any se- 
lected one of a number of well known operations for cor- 
recting pixel data for bad pixels may be used. It is pre- so 
ferred, however, that whatever correction operation is 
used that as much data as possible, including the pixel 
data for pixels N in the current line T06(n) and previous 
line. 106(n-1.) be considered in effectuating the correc- 
tion. As a further enhancement to the invention, the cor- 55 
rection. operation may also consider the characteristic 
features (F) 124 for the pixels in the previous line 106 
(n-1 ) in effectuating the correction. Following correction, 



the modified pixel data 1 1 4' for pixel X is passed to serial 
output 112. 

[0036] FIG. 1 0 shows a flow diagram illustrating one 
embodiment of a process for bad pixel detection per- 
formed by the processor 110 of FIG. 9. In this embodi- 
ment, the bad/good pixel decisions previously made by 
the detection algorithm 128 forthe pixels in the previous 
line 1 06(n-1 ) are used as the characteristic features (F) 
124 stored in the feature buffer 122. These characteris- 
tic features (F) 124 require only a binary (1/0) storage, 
i.e., one bit per pixel. This serves to significantly reduce 
the size of the memory required for the feature buffer 
122 in comparison to that required by the buffer 32 (FIG. 
3) of the prior art. In step 350, the detection algorithm 
128 uses the characteristic features (F) 124 stored in 
the feature buffer 122 and determines whether a per- 
pendicularly adjacent pixel (P) to the pixel X under ex- 
amination was previously detected as being a bad pixel. 
If the determination in step 350 is YES, the process pre- 
cludes a finding that pixel X could be a "bad pixel" and 
the pixel data 1 08 for pixel X is assumed to represent 
valid pixel data for output 112 in its original form 114. 
The process then returns (step 352) to process a next 
pixel. Put another way, if the process determines that 
the pixel (P)in a previous line 1 06(n-1 ) that corresponds 
in position to pixel X is a bad pixel (as indicated by the 
stored characteristic feature), then the pixel X in the cur- 
rent line 1 06(n) is not permitted to be identified as a bad 
pixel. 

[0037] If, on the other hand, the executed determina- 
tion operation of step 350 is NO, the detection algorithm 
1 28 uses the pixel data stored in the buffer 1 1 6* and cal- 
culates (in step 354) local color correlation forthe pixels 
X and N. From this determined color correlation, the al- 
gorithm 128 selects a threshold (TH) for bad pixel de- 
tection in step 356. In this regard, it is noted that bad 
pixels tend to have a different color from neighboring 
pixels. For areas under examination where there is a 
high color correlation among the pixels N, identification 
of pixel X as a bad pixel can be accurately determined 
by color correlating to the neighboring pixels. Thus, the 
threshold (TH) for the comparison to pixel X is set rela- 
tively low. For areas, on the other hand, having a low 
correlation among the pixels N, it is more difficult to dis- 
tinguish a bad pixel from an image feature using a com- 
parison. Thus, the threshold (TH) for that comparison to 
pixel X is set relatively high. 

[0038] More specifically, the local color correlation 
process of step 354 involves splitting the pixels X and 
N in the buffer 116' into two types (for example, A and 
B, as shown in FIG. 10 with an "odd/even" arrange- 
ment). Next, a calculation of a local variance (Var) and 
covariance (Cov) of the two pixel types is made for each 
line 106(n) and 106(n-1) saved in the buffer 116'. The 
calculation may be made, for example, in, accordance 
with: the following: 1 . ;■; 
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Var(A) = E(A 2 ) - E(A) 2 



Var(B) = E(B 2 ) - E(B) 2 



[0041 ] The algorithm next executes step 358 and cal- 
culates an estimate of pixel X from the values of the 
same line 1 06(n), adjacent pixels. More specifically, the 
value of pixel X is estimated from its left and right neigh- 
bors in line 1 06(n) as follows: 



Cov(A,B) = E(AB) - E(A)E(B); 

wherein E() is defined as the mean or average val- 
ue. 

With respect to step 356, a conditional variance is cal- 
culated as follows: 

Var(AIB) = Var(A) - Cov(A,B) 2 / Var(B). 

[0039] The conditional variance measures the cer- 
tainty of an estimate of the value of pixel X (see, the E 
(AIB) calculation below) given the values of the neigh- 
boring pixels. If the certainty is low, this would indicate 
that the threshold for comparison should be set relative- 
ly high, and vice versa. The standard deviation (S) of 
the conditional variance is then determined by taking the 
square root of the conditional variance in a well known 
manner. The threshold (TH) is then set to a value equal 
to n (generally a non-negative integer, or other suitable 
scaling factor) times the standard deviation as follows: 

TH = n * S. 

The value of the threshold (TH) is accordingly set as a 
function of the determined conditional variance that 
measures certainty with respect to pixel X estimation. 
[0040] The foregoing may be better understood by 
reference to some examples. In a first case in which the 
image comprises flat areas having a high color correla- 
tion, the determined variance (Var) is low, the deter- 
mined covariance (Cov) is low, and the determined con- 
ditional variance is also low. The resulting standard de- 
viation is also low and the threshold is set to a relatively 
low value because bad pixels can relatively easily be 
identified in such an image having high color correlation. 
In a second case in which the image comprises edges 
and/or textures having some color correlation, the de- 
termined variance is high, the determined covariance is 
high, and the determined conditional variance is rela- 
tively low. The resulting standard deviation is medium 
and the threshold is set to a medium value because bad 
pixels in some image cases can be difficult to identify. 
In a third case in which the image comprises random 
noise having little color correlation, the determined var- 
iance is high, the determined covariance is low, and the 
determined conditional variance is high The resulting 
standard deviation is high and the threshold is set to a 
relatively high value because bad pixels are very difficult 
to identify in such low color correlation images. 



E(AIB) = E(A) + (Cov(A,B)A/ar(B)) * (B - E(B)). 

It should be remembered that the conditional variance 
determination referenced above measures a level of 
confidence in this estimation that is used to determine 
the threshold (TH) to be applied. Next, in step 360, the 
algorithm processes the pixel data 1 08 for pixel X as 
stored in buffer 1 1 6' and estimate determined in the step 
358. More specifically this step 360 processing sub- 
tracts the step 358 estimate from the data 1 08 value of 
pixel X to obtain a difference value (D) in accordance 
with the following: 

20 - 

D = X - E(AIB). 

[0042] The difference value (D) calculated in step 360 

25 j s then compared in step 362 against the determined 
threshold (TH). More specifically, this step 362 compar- 
ison determines whether the magnitude of the differ- 
ence value (D) exceeds the threshold (TH). If YES, the 
detection algorithm 128 identifies the pixel X under ex- 

30 amination as a "bad pixel" in step 364. This identification 
of pixel X as a bad pixel is recorded in the feature buffer 
122 in step 366. Operation with respect to pixel X then 
proceeds to the correction algorithm 130 to modify the 
pixel data 108 into modified pixel data 114' that more 

35 accurately represents the intensity of the light that is in- 
cident on the photodetector. If, on the other hand, the 
executed comparison operation of step 362 is not sat- 
isfied, this indicates that the pixel is a "good pixel" and 
the pixel data 1 08 for pixel X assumed to represent valid 

40 (i.e., good) pixel data for output 1 12 in its original form 
114. The process then returns (step 352) to process a 
next pixel. 

[0043] The threshold (TH) varies with the calculated 
conditional variance in order to make it more difficult for 

45 the comparison operation of step 362 to be satisfied and 
identify the pixel X as a "bad pixel" when pixel X in line 
1 06(n) is located in area of the image having a low color 
correlation. Notwithstanding the enhanced accuracy in 
bad pixel detection that is provided by using such a var- 

50 jable image correlation based threshold value as illus- 
trated in FIG. 10, the local color correlation process by 
itself may produce an unwanted side effect of vertically 
propagating false bad pixel identifications which result 
in the elimination of photodetector pixel data 108 in ver- 

55 tical lines of the image. The use of the characteristic fea- 
tures (F) 124, and more particularly the process of step 
350 to force an exit from the bad pixel detection algo- 
rithm when a perpendicularly adjacent pixel in a previ- 
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ous line 1 06(n-1 ) is identified as a bad pixel, acts to re- 
duce this unwanted side effect by preventing false bad 
pixel identifications from propagating vertically. 
[0044] The effectiveness of the process for bad pixel 
identification illustrated in FIG. 10 in reducing the un- 
wanted side effect is graphically illustrated in FIG. 11, 
which shows a receiver operating characteristics (ROC) 
graph. The ROC graph plots the false alarm rate which 
indicates the number good pixels being inadvertently 
corrected (i.e., the unwanted side effect), against the hit 
rate, which indicates the number of bad pixels being ac- 
curately corrected. Curve 224 is a representative ROC 
curve for the process in which only local color correlation 
is used to identify bad pixels, while curve 226 is a rep- 
resentative ROC curve for the process shown in FIG. 
1 0. Any shifting of the ROC curve towards the upper left 
hand corner of the graph (i.e., toward a hit rate of 1 and 
a false alarm rate of 0) represents an improvement in 
performance. As shown in FIG. 11, the curve 226 is shift- 
ed in that direction relative to the curve 224. It is accord- 
ingly concluded that there is a significant benefit in im- 
proved performance by applying the perpendicularly ad- 
jacent characteristic feature (F) 124 test. It is also noted 
that, because the characteristic features (F) 124 require 
storage of only a single bit per pixel, the size of the buffer 
122 is significantly reduced and improved performance 
is obtained. 

[0045] While the present invention as disclosed is 
preferably implemented using CMOS technology with 
all (or substantially all) components and functionalities 
implemented on a single integrated circuit chip, it will be 
understood that other semiconductor fabrication tech- 
niques could be used, and further that components and 
functionalities may be split among and between multiple 
chips and/or devices. 

[0046] The processing operations of the disclosed 
methods concerning the detection and correction algo- 
rithms are preferably implemented using microproces- 
sor or application specific integrated circuit (ASIC) tech- 
niques. It will, of course, be understood that separate 
processing devices may be interconnected in certain 
applications to the sensor array. 
[0047] It should also be recognized that the methods, 
systems and processes described herein are equally 
useful in connection with both color and black/white sen- 
sors. 

[0048] The threshold values described herein may be 
changed and set in any of a number of ways depending 
on where a user desires to set operation with respect to 
the ROC curve. As an example, the device may be man- 
ufactured as a chip with settable values, and further in- 
clude an input mechanism to allow the user preferen- 
tially change the set values. 

[0049] With respect to the implementations of FIGS. 
5 ahd : 9, it will be understood by those skilled in the art 
that some instances may arise where the detection/cor- 
rection functionalities (references 128 and 130) are not 
desired. In these instances, the functionalities 128 and 



1 30 may be selectively by-passed under user control to 
allow the raw output data from the buffer 104 to pass 
straight through for more sophisticated processing. 
[0050] The feature buffer 122 is disclosed as saving 

5 the characteristic features (F) for the pixels of a single 
preceding line 106(n-1). While this is an embodiment, it 
will be recognized that the feature buffer 122 may in- 
clude sufficient memory to store characteristic features 
for the pixels of plural preceding lines (for example, 106 

10 (n-1 ) and 1 06(n-2), as shown in phantom in FIG. 9). Fur- 
thermore, it will be recognized that different character- 
istic features may be stored by the buffer for the pixels 
of different lines. As one example, the multi-line feature 
buffer 122 may store characteristic features comprising 

15 bad pixel identifications for the past two lines 1 06(n-1 ) 
and 106(n-2). As another example, the characteristic 
features stored by the multi-line feature buffer 122 for 
the immediately previous line 106(n-1) may include not 
only bad pixel identification, but also some other char- 

20 acteristic features, while the next previous line 1 06(n-2) 
includes only the bad pixel identification data. When 
storing additional previous line's worth of characteristic 
features (i.e., features for lines beyond line 106(n-1)), 
these additional features can be included and consid- 

25 ered in the evaluations performed by the detection al- 
gorithm 128. An advantage provided by such storage 
would include improvement in algorithm performance 
for catching "corner cases" with only a minimal increase 
in the amount of required data storage for the feature 

30 buffer 122. 

[0051] It is recognized that the feature buffer 122 is 
used to save on computation. For example, considerthe 
case where both current and previous line pixel data is 
stored along with the characteristic features for the pix- 

35 els of those lines. Theoretically speaking, the stored pre- 
vious line values could be used to generate the charac- 
teristic features. However, these computations are, gen- 
erally speaking, similar to, if not identical to, those com- 
putations that performed in connection with the process- 

40 jng of the current line values to identify bad pixels. Ac- 
cordingly, when scanning and processing the values for 
the current line, the bad pixel identifications are deter- 
mined and stored in the feature buffer thus obviating the 
need to store previous line pixel data and perform the 

45 computations again. 

[0052] Although preferred embodiments of the meth- 
od and apparatus of the present invention have been 
illustrated in the accompanying Drawings and described 
in the foregoing Detailed Description, it will be under- 
go stood that the invention is not limited to the embodi- 
ments disclosed, but is capable of numerous rearrange- 
ments, modifications and substitutions without depart- 
ing from the invention as set forth and defined by the 
following claims. 

55. ■ . '.■ v .- *■.•-..■ - ■ r- • 



9 



BNSDOCID: <EP 1271933A2J_> 



17 



EP 1 271 933 A2 



18 



Claims 



A sensor (100), comprising: 

an array of photodetectors (102), each photo- 
dector generating pixel data (108) indicative of 
incident light thereon; and 
a bad pixel processor (110) including: 

a first buffer (104) storing pixel data (1 08) 
for a certain pixel in a current line of the 
array and pixel data (108) for pixels adja- 
cent to the certain pixel; 
a second buffer (122) storing a character- 
istic feature (124) for each of the pixels in 
a line of the array previous to the current 
line; and 

a detector (128) that processes the pixel 
data (108) stored in the first buffer (104) 
and the characteristic features stored in the 
second buffer (122) to identify whether the 
certain pixel in the current line is a bad pix- 
el. 



2. The sensor (1 00) as in claim 1 , further including: 25 



a corrector that processes the pixel data (1 08) 
stored in the first buffer (1 04) to determine cor- 
rected pixel data (108) for the certain pixel if the 
detector (128) identifies the certain pixel as a 
bad pixel. 



The sensor (100) as in claim 2 wherein the deter- 
mined corrected pixel data comprises pixel data 
(108) stored in the first buffer (104) for at least one 
pixel adjacent to the certain pixel in the current read 
out line. 

The sensor (100) as in claim 2 wherein the deter- 
mined corrected pixel data comprises an average 
or median of the pixel data (108) stored in the first 
buffer (1 04) for the pixels adjacent to the certain pix- 
el. 

The sensor (1 00) as in one of the preceding claims 
wherein the characteristic feature (124) comprises 
data identifying whether the pixel in the previous 
line was identified as a bad pixel. 

The sensor (1 00) as in claim 5 wherein the detector 
(128), in processing the characteristic features 
stored in the second buffer (122), precludes identi- 
fication of the certain pixel in the current line as a 
bad pixel when the characteristic feature (124) for 
a pixel in the previous line that is adjacent to the 
certain pixel in the current line identifies the adja- 
cent pixel as being a bad pixel. 



10 



15 



20 



7. The sensor (1 00) as in claim 5 wherein the detector 
(128) processes the pixel data (108) from the first 
buffer (104) to determine a difference value that is 
indicative of a difference between the pixel data 
(1 08) for the certain pixel and a reference pixel val- 
ue. 

8. The sensor (100) as in claim 7 wherein the refer- 
ence pixel value comprises an average or median 
of the pixel data (1 08) stored in the first buffer (1 04) 
for the pixels adjacent to the certain pixel in the cur- 
rent line. 



9. 



The sensor (1 00) as in claim 7 wherein the detector 
(128), when the characteristic feature (124) for a 
pixel in the previous line that is adjacent to the cer- 
tain pixel in the current line identifies the adjacent 
pixel as being a bad pixel, compares the difference 
value to a first threshold value when the adjacent 
pixel is a not a bad pixel, and compares the differ- 
ence value to second threshold value, that is great- 
er than the first threshold value, when the adjacent 
pixel is a bad pixel. 



1 0. The sensor (1 00) as in claim 9 wherein the detector 
(128) identifies the certain pixel in the current line 
as a bad pixel when either of the comparisons indi- 
cates the difference value to exceed the first/sec- 
ond threshold. 

11. The sensor (100) as in one of the preceding claims 
wherein the characteristic feature ( 1 24) is indicative 
of a characteristic of a pixel in the previous line that 
is not related to incident light. 

12. The sensor (100) as in one of the preceding claims 
wherein the first buffer (1 04) further stores pixel da- 
ta (108) for pixels in the previous line. 



40 13. A method for processing pixel data that is indicative 
of incident light that is output from pixels in a pho- 
todetector array, comprising the steps of: 



30 



35 



45 



50 



55 



storing pixel data (108) for a certain pixel in a 
current line of the array and pixel data (1 08) for 
pixels adjacent to the certain pixel; 
storing a characteristic feature (124) for each 
of the pixels in a line of the array previous to 
the current line; and 

processing the stored pixel data (108) and the 
stored characteristic features to identify wheth- 
er the certain pixel in the current line is a bad 
pixel 

14. The method as in claim 13, further including the step 

• ■ : of: v.^Vv.v-v. ■/> . : . ■ 

processing the pixel data (108) stored in the 
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first buffer (104) to determine corrected pixel 
data for the certain pixel if the detector (128) 
identifies the certain pixel as a bad pixel. 

15. The method as in claim 14 wherein the step of 5 
processing comprises the step of replacing the pixel 
data (108) for the certain pixel with the pixel data 

for at least one of the pixels adjacent to the certain 
pixel in the current line. 

w 

16. The method as in claim 14 wherein the step of 
processing comprises the step of replacing the pixel 
data (108) for the certain pixel with an average or 
median of the pixel data for the pixels adjacent to 

the certain pixel. 15 

17. The method as in one of claims 13-16 wherein the 
characteristic feature (124) comprise data identify- 
ing whether the pixel in the previous line was iden- 
tified as a bad pixel. 20 

18. The method as in claim 17 wherein the step of 
processing comprises the step of precluding identi- 
fication of the certain pixel in the current line as a 
bad pixel when the characteristic feature (124) for 25 
a pixel in the previous line that is adjacent to the 
certain pixel in the current line identifies the adja- 
cent pixel as being a bad pixel. 

19. The method as in claim 17 wherein the step of 30 
processing comprises the step of determining a dif- 
ference value that is indicative of a difference be- 
tween the pixel data (108) for the certain pixel and 

a reference pixel value. 

35 

20. The method as in claim 19 wherein the reference 
pixel value comprises an average or median of the 
pixel data stored in the first buffer (1 04) for the pixels 
adjacent to the certain pixel in the same current line. 

40 

21. The method as in claim 19 wherein the step of 
processing further includes the steps of: 

determining whether the characteristic feature 
(1 24) for a pixel in the previous line that is ad- 45 
jacent to the certain pixel in the current line 
identifies the adjacent pixel as being a bad pix- 
el; and 

comparing the difference value to a threshold 
value; 50 



processing further includes the step of identifying 
the certain pixel as a bad pixel when the comparison 
step indicates the difference value exceed the 
threshold. 

23. The method as in one of claims 1 3 - 22 wherein the 
characteristic feature (124) is indicative of a char- 
acteristic of the pixel in the previous line that is not 
related to incident light. 

24. The method as in one of claims 1 3 - 22 wherein the 
step of storing pixel data (108) further includes the 
step of storing pixel data (1 08) for pixels in the pre- 
vious line. 



wherein the threshold is a first threshold value 
if the adjacent pixel is a not a bad pixel, and is a 
second threshold value, that is greater than the first 
threshold value, when the adjacent pixel is a bad; 
pixel. 

22. The method as in claim 21 wherein the step of 
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